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ABSTRACT 



In 1990, the National Assessment of Educational Progress 
(NAEP) included a Trial State Assessment (TSA) ; for the first time in the 
NAEP's history, voluntary state-by-state assessments were made. The sample 
was designed to represent the 8th grade public school population in a state 
or territory. In 1996, 44 states, the District of Columbia, Guam, and the 
Department of Defense schools took part in the NAEP state science assessment 
program. The NAEP 1996 state science assessment was at grade 8 only, although 
grades 4,8, and 12 were assessed at the national level as usual. Both the 
domestic and overseas Department of Defense schools made special arrangements 
to assess their grade 4 students during the national science assessment. The 
results reported here are from the grade 4 assessment of the Domestic 
Dependents Elementary and Secondary Schools (DDESS) . The 1996 state science 
assessment covered three major fields: earth, physical, and life sciences. In 
DDESS, 1,251 students in 39 public schools were assessed. This report 
describes the science proficiency of DDESS fourth-graders, compares their 
overall performance to students in the entire United States (using data from 
the NAEP national assessment) , presents the average proficiency for the three 
major fields, and summarizes the performance of subpopulations (gender, 
race/ethnicity, parents' educational level, Title I participation, and 
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free/reduced lunch program eligibility) . To provide a context for the 
assessment data, participating students, their science teachers, and 
principals completed questionnaires which focused on: instructional content 
(curriculum coverage, amount of homework) ; delivery of science instruction 
(availability of resources, type) ; use of computers in science instruction; 
educational background of teachers; and conditions facilitating science 
learning (e.g., hours of television watched, absenteeism). On the NAEP fields 
of science scales that range from 0 to 300, DDESS students had an average 
proficiency of 154 compared to 148 throughout the United States. The average 
science scale score of males did not differ significantly from that of 
females in DDESS. However, the scores of both DDESS males and females were 
significantly higher than for males and females nationwide. At the fourth 
grade, White students in DDESS had an average science scale score that was 
higher than those of Black and Hispanic students. (SGE) 
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continuing assessment of what America’s students know and can do in various subject areas. Since 1969, assessments have been conducted 
periodically in reading, mathematics, science, writing, history/geography, and other fields. By making objective information on student 
performance available to policymakers at the national, state, and local levels, NAEP is an integral part of our nation’s evaluation of the 
condition and progress of e'ducation. Only information related to academic achievement is collected under this program. NAEP auarantees 
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NAEP is a congressionally mandated project of the National Center for Education Statistics, the U.S. Department of Education The 
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An error was recently discovered in the national and regional data presented in 
Table 6.2 of the 1996 science state reports. For all states and jurisdictions, the data are correct; 
however, incorrect national data made it necessary to recompute comparisons between state and 
national results. The error involved the student background item, “About how many books are in 
your home?” which is reported in the NAEP 1996 Science State Report in Table 6.2, as well as in 
the bullets comparing your jurisdiction with the nation. 

Attached to this memo are the two corrected pages to insert into your printed reports. If 
you received camera-ready copy of the NAEP 1996 science state report, we have also enclosed 
pages for insertion there. The pages are for Chapter 6 in the section on “Literacy Materials in the 
Home” which includes Table 6.2; they contain revised comparisons to national data, and revised 
national and regional data in the table. We apologize for the publication of inaccurate data, and 
for the extra effort its correction will cause you. 

The state science reports also appear on the NCES web site (http://nces.ed.gov/naep). 
All affected reports on the web were corrected on December 17. There is now a Revised logo 
beside the reports on the Index of Results and Summary Data web page 
(http://nces.ed.gov/naep/rsdindex.shtml) and on the Current Assessment Results web page 
(http://nces.ed.gov/naep/naep1996.html), and an Errata Notice containing a brief description 
of the repair on the NAEP 1996 Science State Reports web page 
(http://nces.ed.gov/naep/96state/97499.shtml). 

Also on the web site, the student data tables for national science results for public 
schools have been revised. On the web page for NAEP 1996 Summary Data Tables, Student Data 
(http://nces.ed.gov/naep/tables96/index.shtml), you will see an Errata Notice describing the 
repair. Please alert anyone who may be using national 1996 science student data to this revision 
concerning the raw variable, “How many books are in your home,” and the derived variable 
H0MEEN3, “Home environment - Articles (of 4) in home.” 

We very much regret the extra work that this error may have necessitated in your 
jurisdiction; we will redouble our efforts to prevent such things happening again. 
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HIGHLIGHTS 



^^[onitoring the performance of students in subjects such as science is a key concern 
of the citizens, policy makers, and educators who direct educational reform efforts. The 1996 
National Assessment of Education Progress (NAEP) in science assesses the current level of 
science performance as a mechanism for informing education reform. This science assessment is 
the first to be constructed on a new framework. 

The Department of Defense Education Activity (DoDEA) comprises schools in the 
domestic United States as well as schools attached to United States agencies overseas. The 
DoDEA domestic and overseas schools both participated in the 1996 science state assessment 
program at grade 8, and both jurisdictions also made special arrangements to assess their grade 4 
students during the national science assessment. The results reported here are from the grade 4 
assessment of the Domestic Dependents Elementary and Secondary Schools (DDESS). The 
results for fourth graders from the overseas Department of Defense Dependent Schools (DoDDS) 
are in a companion report. 

What is NAEP? 

The National Assessment of Educational Progress (NAEP), the “Nation’s Report Card,” 
is the only ongoing nationally representative assessment of what students in the United States 
know and can do in various academic subjects. Since 1969, NAEP assessments have been 
conducted with national samples of students in the subject areas of reading, mathematics, 
science, writing, and other fields. By making information on student performance available to 
policy makers, educators, and the general public, NAEP is an integral part of our nation’s 
evaluation of the conditions and progress of education. 

NAEP is a congressionally mandated project of the National Center for Education 
Statistics (NCES), U.S. Department of Education. Results are provided only for group 
performance. NAEP is forbidden by law to report results at an individual or school level. 

In 1990 Congress authorized a voluntary state-by- state NAEP assessment. State-level 
assessments have taken place in mathematics (in 1990, 1992, and 1996), and reading in 1992 and 
1994. In 1996, 44 states, the District of Columbia, Guam, and the DoDEA schools volunteered to 
take part in the NAEP State Assessment Program at grade 8. The results for each jurisdiction are 
reported in the NAEP 1996 Science State Reports, which are available in print and also on the 
NCES web site (http://www.ed.gov/NCES/naep). 
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NAEP 1996 Science Assessment 

The framework for the science assessment was produced through a national consensus 
process by educators, administrators, assessment experts and curriculum specialists. The 
framework was designed to reflect current practices in science teaching. It called for the use of 
multiple-choice questions and constructed-response questions that required both short and 
extended responses. The constructed-response questions served as indicators of students’ ability 
to know and integrate facts and scientific concepts, the ability to reason, and the ability to 
communicate scientific information. In the 1996 assessment, these constructed-response 
questions constituted nearly 80 percent of the total student response time. The NAEP 1996 
assessment in science also included hands-on tasks that enabled students to demonstrate directly 
their knowledge and skills related to scientific investigation. 

The 1996 science framework was structured according to a matrix that consisted of the 
three traditional fields of science (earth, physical, and life) crossed with three processes of 
knowing and doing science (conceptual understanding, scientific investigation, and practical 
reasoning). A central category encompassing the nature of science and the nature of technology 
was woven throughout the assessment, as was a themes category representing major ideas or key 
concepts that transcend scientific disciplines. 

Students’ science performance is summarized on the NAEP science scales, which range 
from 0 to 300 at each grade. While the scale score ranges are identical for grades 4, 8, and 12, the 
scales were derived independently at each grade. Scale scores on the grade 4 scale cannot imply 
anything about performance at grade 8 in the assessment. 
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Comparison of DDESS to the Nation 

Table H.l shows the distribution of science scale scores for the fourth-grade students 
attending DDESS schools in 1996. For this table and the others throughout this report, the results 
shown for Nation are from the national sample of public schools only. 



• The average science scale score for fourth graders in DDESS was 154. This 
average was significantly higher than that for the nation (148).' 
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TABLE H.l 


Distribution of Science Scale Scores for Grade 4 Students 


State Assessment 





Average 
Scale Score 


10th 

Percentile 


25th 

Percentile 


50th 

Percentile 


75th 

Percentile 


90th 

Percentile 






DDESS 

Nation 


154 (0.9) 
148 (0.9) 


116 (3.0) 
103 (1.3) 


134 (1.6) 
127 (1.8) 


155 (1.5) 
151 (1.2) 


175 (1.1) 
172 (0.9) 


190 (1.9) 
188 (1.4) 



The NAEP science scale ranges from 0 to 300. The standard errors of the statistics appear in parentheses. It can be said with about 
95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors of the 
estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see Appendix A for details). 
SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 Science 

Assessment. 



1 Differences reported as significant are statistically different at the 95 percent confidence level. This means that with 95 percent 
confidence there is a real difference in average science scale score between the two populations of interest. 
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Major Findings for Student Subpopulations 

The preceding section provided a view of the overall science performance of fourth- 
grade students in DDESS. It is also important to examine the average science scale scores of 
subgroups within the population. Typically, NAEP presents results for demographic subgroups 
such as those defined by gender, race/ethnicity, and parental education. In addition, in 1996 
NAEP collected information on student participation in two federally funded programs — Title I 
and the free/reduced-price component of the National School Lunch Program. 

The reader is cautioned against using NAEP results to make simple or causal inferences 
related to subgroup membership. Differences among groups of students are almost certainly 
associated with a broad range of socioeconomic and educational factors not discussed in NAEP 
reports and possibly not addressed by the NAEP assessment program. 

Results related to gender and race/ethnicity are highlighted below. More complete results 
for the various demographic subgroups examined by the NAEP science assessment can be found 
in Chapters 2 and 4 of this report. 

• The average science scale score of males (153) did not differ from that of 
females (154) in DDESS schools. However, the scores of both males and 
females were significantly higher than for males (149) and females (148) 
nationwide. 

• At the fourth grade, White students in DDESS demonstrated an average science 
scale score (164) that was significantly higher than that of Black (143) and 
Hispanic students (144). 

Finding a Context for Understanding Students’ Science Performance 

The science performance of students in DDESS may be better understood when viewed 
in the context of the environment in which students are learning. This educational environment is 
largely determined by school policies and practices, by characteristics of science instruction in 
the school, by home support for academics and other home influences, and by students' own 
views about science. Information about this environment is gathered by means of questionnaires 
completed by principals and teachers as well as questions answered by students as part of the 
assessment. 

Because NAEP is administered to a sample of students that is representative of all 
fourth-grade students in the DDESS, NAEP results provide a view of the educational practices 
that may be useful for improving instruction and setting policy. However, despite the richness of 
context provided by the NAEP results, it is very important to note that NAEP data cannot 
establish a cause-and effect relationship between educational environment and students’ scores 
on the NAEP science assessment. 
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School Science Education Policies and Practices 2 

• In DDESS, the percentage of fourth-grade students attending schools that 
reported science was a priority (42 percent) was not different from the 
percentage of fourth-grade students nationwide (42 percent). 

• The percentage of fourth-grade public school students in DDESS who 
attended schools that reported having a district or state science curriculum 
that the school was expected to follow (87 percent) was not significantly 
different than the national percentage (92 percent). 

• In DDESS, 68 percent of fourth graders attended schools that reported 
providing instruction in science every day. This percentage was greater than 
that of fourth graders across the nation (47 percent). 

• A small percentage of students in DDESS had teachers who reported 
receiving all of the resources they needed for science instruction in DDESS 
(18 percent). This was higher than that of fourth-grade public school 
students nationwide (10 percent). 

• In DDESS, 52 percent of the fourth-grade students were taught by teachers 
who reported that there was a curriculum specialist available to help or 
advise the teachers in science. This figure did not differ significantly from 
that of students across the nation (47 percent). 

Science Classroom Practices 3 

• Less than half of the fourth-grade students in DDESS had science teachers 
who reported spending a lot of time on life science (40 percent), about one 
third reported spending a lot of time on earth science (32 percent), and about 
one third reported spending a lot of time on physical science (30 percent). 

• In DDESS, 49 percent of the fourth graders had teachers who planned to 
emphasize heavily the students’ knowledge of science facts and terminology. 
At the other extreme, 3 percent of the students had teachers who planned 
little to no emphasis on this topic. 

• Teachers of 61 percent of the fourth-grade students reported that they placed 
heavy emphasis on developing science problem-solving skills. A small 
percentage of the students (3 percent) had teachers who reported spending 
little or no time addressing this topic. 

• In terms of learning how to communicate ideas in science effectively, 34 
percent of the fourth-grade students in DDESS had teachers who reported 
heavily emphasizing this ability for their students, while 7 percent of the 
students had teachers who reported giving little to no emphasis on this topic. 



2 More detailed results related to school policies and practices can be found in Chapter 3 of this report, the NAEP 1996 Science 
Report for Grade 4 DoDEA/DDESS. 

3 Ibid.: More detailed results related to classroom practices can be found in Chapter 4 of this report. 
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